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1 Introduction 

o: 

We discuss here the behavior of ergodic means of discrete time dynamical systems on a very big finite probabiUty 
P5 , space Y (discrete dynamical systems below). The G. Birkhoff Ergodic Theorem states the eventual stabilization of 

ergodic means of integrable functions for almost all points of the probability space. The trivial proof of this theorem 
for the case of finite probability spaces shows that this stabilization happens for those time intervals, whose length n 
exceeds significantly the cardinality |F| of F, i.e. jpj is a very big number 

For the case of a very big number we introduce a huge class of functions on Y including, for example all 
bounded functions, i.e. those functions, whose values are significantly less, than Functions of this class are said 
. to be S'-integrable (the formula Q below). The class of S'-integrable functions is an analog of the class of integrable 

functions on an infinite probability space. 
(~| . We show that the behavior of ergodic means of S'-integrable functions demonstrates some regularity even for those 

■ intervals, whose length is comparable with \ Y\. The ergodic means A„ and A,„ on the intervals of time {0, . . . , m — 1 } = 
m and {0, ...,n — 1} = n are approximately the same if ^ w ^ 0. It means that if we plot the points (^,A„) 
on the coordinate plane, we obtain the graph of a function continuous on (0,°°) (Theorem|6]). The behavior of this 
function in the neighborhood of the origin is more complicated. We show in Example 3 below the existence of an 
5-integrable function, for which there exist very big intervals m,n such that w w 0, but A„ A,,,. However, 
Theorem|7] shows stabilization of ergodic means on some initial segment of very big moments. In other words there 

, exists a very big number m such that for all very big numbers n < m one has A„ w A„, for almost all y GY, i.e. the 

■ share of those y GY, for which the statement is not true, is infinitesimal. It is interesting that the proof of this theorem 
uses the Ergodic Theorem for infinite probability spaces and is equivalent to the last one in some sense. 

We consider specially the case of discrete dynamical systems that are approximations of dynamical systems on 
, compact metric spaces. We introduce here a definition of such approximations (Definition|5]below). The existence of 

(N. approximations in the sense of Definition|5]is proved for a huge class of dynamical systems on compact metric spaces 

(see Section 4). 

The approach to approximation suggested here differs from the most popular approach in ergodic theory based 
on Rokhlin's Theorem (see e.g. |3|). The Nonstandard Analysis (NSA) approach to Rokhlin's finite approximations 
of Lebesgue dynamical systems will be discussed in another paper. Some preliminary results were announced in 
, Is). Rokhlin's approximations have many interesting applications to ergodic theory, especially to problems connected 

with the entropy of dynamical systems. However, Definition |5] is more appropriate for investigation of computer 
simulation of continuous dynamical systems (see e.g. Example 6). We show also that the existence of a dynamical 
system on a compact metric space, for which a given very big finite dynamical system is an approximation, gives 
some additional information about the the behavior of the finite dynamical system on very big intervals of time (see 
Proposition |22] and Theorem|9]below). 

Our approach provides some deeper understanding of the interrelation between very big discrete dynamical sys- 
tems and continuous dynamical systems it the spirit of the approach formulated in [14J: "Continuous analysis and 
geometry are just degenerate approximations to the discrete world... While discrete analysis is conceptually simpler 
... than continuous analysis, technically it is usually much more difficult. Granted, real geometry and analysis were 
necessary simplifications to enable humans to make progress in science and mathematics....". In some sense, our 
paper contributes to this idea for dynamical systems. 
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Properties involved in the discussion above (very big set, very small number, etc.) obviously are not well defined. 
They strongly depend on the problems, where they are used. Let us call them vague properties. They cannot be 
formalized in the framework of the standard mathematics based on the G. Cantor's Set Theory. In this theory a set 
is understood as a collection of objects that satisfy a certain property that is well defined. This means that any two 
persons agree about any object, if this object has a given property or not. In other words one can definitely say about 
any object, if this object is an element of a given set or this is not the case. 

Vague properties do not define sets. Consider, for example, the collection Q. of all very big natural numbers. If 
we accept the existence of a very big number, then the collection £1 is not a set. Indeed, if i2 is a set, then, obviously 
N \ il is a set. It is cleai" intuitively, that G N \ il and if n e N \ £2, then « + 1 e N \ £2. So, by Axiom of Induction 
n = 0. 

This argument comes up to the well-known paradox of a heap sand due to Eubulides (IV century B.C.): A single 
grain of sand is certainly not a heap. Nor is the addition of a single grain of sand enough to transform a non-heap 
into a heap: when we have a collection of grains of sand that is not a heap, then adding a single grain will not create 
a heap. And yet we know that at some point we will have a heap. 

This paradox cannot be resolved in the framework of conventional (standard) mathematics, since the property "to 
be a heap of sand" is a vague property. On the other hand, vague properties are very common in natural sciences, 
economy and other areas of application of mathematics. Arguments, using them can be met in many investigations 
in these areas. These arguments seem to be quite convincible. Moreover, we will see below that the formalization 
in the framework of standard mathematics of some statements and arguments involving vague properties may be too 
complicated or even irrelevant. 

Nonstandard Analysis, discovered by A. Robinson in the 60-s of the previous century introduced constant in- 
finitesimals and infinitely large numbers in mathematics on the contemporary level of mathematical rigor It opened 
the way to use vague collections (called the external sets in NSA) rigorously. The methods of NSA found numerous 
applications in the various areas of mathematics from mathematical physics to mathematical economics (see, e.g. 
E] m [TT|). However, in the most of the papers nonstandard analysis is used as a tool to obtain results in standard 
mathematics. 

The results mentioned in the beginning of this Introduction have more natural formulations in terms of vague 
properties rather than in the framework of the standard mathematics. Some of them, like Theorem|6] can be simply 
reformulated in the framework of standard mathematics in terms of sequences of finite probability spaces, other, like 
Theorem |7] do not have simple meaningful standard formulation. However, Theorem [T] has clear meaningful sense 
and can even be monitored in computer experiments (see Example 3). 

Section 2 contains a brief introduction to NSA. We discuss the formalization of the vague properties mentioned 
above. In particular, the formalization of the notion of a very big (very small) number is the formal definition of 
infinite (infinitesimal) numbers in the NSA. The numbers that are not very big are called bounded ox finite. We 
say that two elements a and j3 of a metric space are infinitesimally close (a ~ j3), if the distance between them is 
infinitesimal. A very big finite set is defined as a set, whose cardinality is an infinite natural number Not very big sets 
are said to be standardly finite. As a rule we call them just finite sets if it does not yield a misunderstanding. There are 
no new results in this section, however, the exposition of the introduction to NSA is new. Some proofs in this section 
are given for illustration of the basic principles of NSA. 

We try to make the exposition in Section 2 not too formal. Nonstandard analysis has one feature, that makes 
the achievement of this goal a little bit more difficult, than in the standard mathematics. One of the main axioms of 
NSA, the Transfer principle is a statement about all conventional mathematical propositions. To make this statement 
mathematically rigorous one has to provide a formal definition of mathematical language. This can be done, for 
example, in the framework of the Axiomatic Set Theory. To avoid excessive formalization, we skip formal description 
of the mathematical language, assuming that every reader understand intuitively what is a conventional mathematical 
proposition and can easily apply the Transfer Principle to any concrete proposition. 

The formulations of the main results of the paper formulated both in the language of the NSA and in the framework 
of the standard mathematic, their discussion, illustration by examples and proofs of some simple statements are 
contained in Section 3. It is possible to understand the formulations of the main theorems of the paper (Theorem|6] 
|7][8]and|9]l on the intuitive ("physical") level before reading Section 2, if to interpret an infinite number as a very big 
number, an infinitesimal as a very small number, a hyperfinite set as very big finite set, an internal set as a usual set, 
an external set as a collection of objects defined by a vague property. For example, under this interpretation the set 
*N is the set of all natural numbers, while N is a collection of not very big numbers. 

The rigorous formulations of the definitions and of the main results in terms of sequences of dynamical systems 
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on finite probability spaces are contained in the part iv) of Section 3. The proofs of Theorems I6I7I8] are contained in 
Section 4. 

Acknowledgements. The authors are grateful to Peter Loeb, Edgardo Ugalde for helpful discussions of various 
parts of this paper and to Andrew Mertz and Kamlesh Parwani for their help with computer experiments. 

2 Basic Nonstandard Analysis 

i) We deal with some standard universe § that contains all objects necessary to develop a huge part of standard 
mathematics. 

Definition 1 A set § is said to be a standard universe, if 

1. thefieldRGS, 

2. aeAeS=^aeS, 

3. A e § =^ .^{A) = {B C A} e S, 

4. A,Be§=^AxB,A^eS, 

5. if all elements a of A G S are sets, then I |J a j € S, 

6. any finite set of elements ofS is an element o/S, 
Proposition 11). If a setA^S and B C A, then B eS 

2). If I e S, {Ai I / e /} e §, then l\Aie§ 

iei 

Proof. 1) Since B e ^(A) and ^(A) e § by property 3 of Definition[T]then Be Shy property 2. 

2) The set B = e S C ( U A/ ) = A. The set A e § by properties 4 and 5. Thus, B e § by the statement 1 of 

i£i Kiel ) 

this Proposition. □ 

We use the following notation; Let 21 be any collection of objects and let <I> be a standard sentence. We write 
21 1= <I> if <I> is true in 21. This means that «& is true, if all variables involved in it assume values in 21. In this paper we 
use for 21 either the collection § or the collection *S introduced below. 

It is easy to see that most part of the mathematical theorems are true in §. Indeed, since the field R S § then the 
operations of addition and multiplication, as well as the order relation is in S. Since the elements of all sets in § are 
also in § the axioms of linearly ordered fields for M are true in S. The axiom of the least upper bound for R is true in 
§ due to Proposition[T](l). One of the important axioms of set theory is the 

Separation Axiom. For an arbitrary set B, standard property <l>(x,yi, ...jn) and elements ti,...tn there exists a set 
C = {heB\ <I>(fe,fi,...,f„)is true}. 

This axiom also follows from Proposition[T](l): if B e S and fi , G S, then C G S, since C C B. 

The Axiom of Choice states that the direct product of any family of non-empty sets is a non-empty set. Its validity 
in § follows from Proposition [T] (2) and Definition [T](l). 

It is accepted by the most part of mathematicians that any mathematical statement can be formalized and proved 
(if it is provable) in the framework of the Zermelo-Fraenkel axiomatics for set theory (ZFC). Besides the Separation 
Axiom and the Axiom of Choice this system contains the Axiom of infinity that is true in §, since N € S, the Axiom of 
the Unordered Pair that follows from DefinitionJT](6), the Axiom of Union, the Axiom of the Power Set that follows 
from Definition[T](3) , the Axiom of Regularity!^ and the Axiom of Replacement, that is not true in §. The axiomatics 
that contains all listed above axioms except the Axiom of Replacement is the Zermelo axiomatics. The Zermelo 
Axiomatic is enough for formalization of all concrete mathematics (analysis, differential equations, mathematical 
physics, geometry, etc.), while the Replacement Axiom is used only for the needs of Foundations of Mathematics. 
For example, it is used in the proof of existence of a set S, that satisfies Definition[T] 

The above discussion justifies the following 

' Actually the axiom of regularity was introduce later by John von Neumann 
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Metatheorem 1. Every theorem provable in Zermelo Axiomatics is true in §. 

ii) We extend the standard universe S by adding infinite, numbers, infinitesimals and some other objects. A good 
intuition for working with the nonstandard extension *§ of S is provided by the following point of view. We consider 
the standard universe S as the universe of visual objects, while *S is obtained by adding to § objects visual through a 
microscope (e.g. infinitesimals) and through a telescope (e.g. infinite numbers). 

If f € § and f is not a set, then t e *§. If a set A e S, then A may be extended in *S, by adding some nonstandard 
elements. The nonstandard extension of a set A e § is denoted by *A. The set *A € *S. For example, we will see later 
that the nonstandard extension *M of the set M consists of infinite numbers, infinitesimals and numbers of the type 
t + a, where f e M and a w 0. The elements of §, that are not sets and the sets of the the form *A, where A S §, are said 
to be standard elements of *§. To study the universe *S we use the conventional language of mathematics extended 
by the predicate S(x) that is interpreted as "x is standard". We denote by S also the collection of all standard elements 
of *§. So, to write S(ji:) is the same as to write x€S. We use the abbreviations V^'' ... and 3^^x ... for Vx(S(ji:) ...) 
and 3x (S(jic)&...) respectively. Let <1> be a proposition that may contain some free variables assuming values in § or 
in *§. Then O^*- is a proposition that is obtained from <I> by replacing any quantifier V (3) by V^'' (B^*-). All elements 
of *S (sets and not sets) are said to be internal elements. Propositions formulated in conventional language are said to 
be internal. Propositions containing the predicate S and the map * are said to be external. External propositions are 
used to describe vague properties discussed in the Introduction. 

We introduce now the axioms for the nonstandard universe *§. These axioms are simplified versions of the axioms 
of one the axiomatic nonstandard set theories - the theory HST (Hrbacek Set Theory) (| 10|). 

We say that a proposition is a sentence if all variables involved in <I> are connected by quantifiers 

I. There exist an injective map * : § — > S ( *(§) := S) such that for any element f G § that is not a set one has *t = t. 

II. (Transitivity of *§) If A e *§ and a e A, then a G *§. 

III. (Transfer Principle) If <I>(xi , ...,Xn) is an internal proposition and oi , G S, then 

§h1>(«i,-,««)^ *Sh<I>(*fli,...,*fl«)^ *Sh*'H*«i, -,*«„). 
The Transfer Principle immediately implies 

Metatheorem 2. Every theorem provable in Zermelo Axiomatics is true in *§. 
The next propositions easily follow from the Transfer Principle. 

Proposition 2 The bijection * preserves the boolean operations on sets and finite cartesian products. 

Proof. Let A,B,f G S. Then one has f G (ARB) i — > t G A&f G B. So, by Transfer Principle 

*t G *{AC\B) < — > *t G *A&*t G *B. 

Thus, 

y^h{t G *{Ar\B)i — >t e *A&t G *B). 

Again, by Transfer Principle 

Vf(f e*{AnB)i — >te *A&t g *b) 

is true, which means that *(A DB) = *A n *B. For the other operations the proof is similar. □ 

Remark 1 To understand the second part of the proof, keep in mind that the set *A, *B and *(A H B) may contain not 
only standard elements. 

We say that the proposition «t'(x) defines the standard element f G S if the following statement is true in S: 

4>(r)&Vy(4>(y) ->3; = f) 



Proposition 3 If a proposition <I>(x) defines an element f G S, then it defines *t G *§ 
□ 
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Corollary 1 a). *0 = 0. 

b). If a set A — {ai, ...,a„} e S, then *A — *fl„}. 



To prove the statement b) of this Corollary first prove it for n = 1 using the Transfer Principle, then apply the 
induction by n e N. 

IV. (Idealization Principle) If a set A e § is infinite, then *A\A^%. 

Proposition 4 IfN e *N\N= *Noo, then for any n G N one has N > n. 

Proof. If < n for some n e N, then e *{0, ....«} = {0, ...,n} by Corollary [T](b). Thus, N eM. The contradiction. 

□ 

Obviously, if g *Noo, then - 1 e *Noo. Thus, the set *N«, does not have a minimal element and the set N 
satisfies the antecedent of Induction Principle, however N ^ *N. So, the sets N and *Noo are not internal sets, since, 
by the Transfer Principle, the Induction Principle is applicable to internal subsets of *N. 

We see, thus, that the property 3 of Definition [T] fails for the nonstandard universe *S. There exists a set A and a 
subset B C A, such that A e *§ and B ^ *§. 

Definition 2 We say that a set B is external, if it is not an internal set, but is a subset of an internal set. 

We extend the nonstandard universe by adding all external sets: *§ := *§ U {B C *5 | B is an external set} 
We use the abbreviations \/^^^x ... and 3^^^x ... for Vx(x S *S ...) and 3x x € *S&...) respectively. Let <I> be 
a proposition (maybe external) that may contain some free variables assuming values in § or in *S. Then (^^^^ is a 

St 

proposition that is obtained from <I> by replacing any quantifier V (3) by V"^'' (3"^*^). There is no need to write V^'^'' x 

St 

or 3^'^'- X, since if x G S x e *§. Notice that <t>^'^'- is an external proposition even ifO is an internal proposition 
since the proposition x e *S is defined in terms of the map *. Obviously for every external proposition <t> and every 
internal proposition ^ one has 



Remark 2 The propositions of the form we call in this paper Nelson-type propositions, since E. Nelson was 
the first who suggested a formal axiomatic (1ST) for internal sets in conventional language extended by the predicate 
"x is standard" - the analog of our predicate x G S and who wrote the first exposition of probability theory in the 
framework of 1ST ^72] |75]? 

The main results of this paper are formulated as Nelson-type sentences, since only this sentences are most intu- 
itively clear formalizations of the statements containing the vague notions discussed above. However, in the proves 
we use propositions that involve variables assuming values of arbitrary external sets. These propositions make many 
of proofs much simpler, than if we restrict ourselves to the arguments that can be formalized in 1ST. 

Definition 3 We say that an internal set A is finite, if there exists n G *N and an internal bijection ^ : A — > {1, ...,n}. 
In this case we say that the cardinality \A\ of A is equal to n. If\A\(z *Noo, then we say that A is a hyperfinite set. If 
\A\ G N, then we say that A is standardly finite (s-finite) set. 

Remark 3 If is the definition of a finite set in the conventional mathematics, then the statement used for the 
definition of a finite set in Definition\3\is the proposition O'''^ So it would be more correct to call the number \A\ 
defined in Definition\3\the internal cardinality. However, the real cardinality of A, i.e. the cardinality of A in the 
"global" universe of all sets may strongly depend on the properties of *§ and is never used in applications ofNSA. 
So, we prefer to to keep the term "cardinality" for the internal cardinality, and to call the real cardinality of a set 
the external cardinality. It agrees with our intuition, according to which the set *N is the set of all natural numbers 
that includes also those numbers that can be seen through a telescope. The cardinality should be a well-defined ( not 
vague) notion, that is why it must be an internal (not external sets). The definition of a hyperfinite set is a formalization 
of the vague notion of a very big set. The definition of an s-finite set is a formalization of the vague notion of a not too 
big set. Obviously the external cardinality of a hyperfinite set is infinite. On the other hand, it can be easily proved 
by induction that if an internal set is s-finite, then its internal cardinality is equal to its external cardinality and every 
set, whose external cardinality is a standard natural numbers, is an internals set. 




(1) 
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V. (Saturation Principle) 0. If an external sequence {A„ | n e N} of internal sets has a finite intersection property 
(i.e. VneN n 7^ 0), then fl 7^ 0. 

iii) The following definition contains the formalization of the vague notions of very big and very small numbers. 
Definition 4 We say that 

1. a number i2 G *R is infinite (D, ^ °°}, if \Q.\ > N for all G N. A number a G *M that is non-infinite is said to 
be bounded or finite (a <^°°). 

2. A number a G *M is said to be infinitesimal a ~ 0, if \oc\ < for all G N. Two numbers (X and j3 are 
infinitesimally close a ~ j3, ;/a — j3 ~ 0. We write \a\ 3> 0, if OL is not an infinitesimal number. 

3. A number f G M /i said to be a standard part (or a shadow) of a bounded number a (t = °a), if t ~ CC. 
The existence of infinite and infinitesimal numbers follows from Proposition |4] 

We denote the set of all bounded numbers by *Ri,. If f G M, then the set M(f ) = {a G *R |a sa f} is called the 
monad off. 

The properties of infinite, bounded and infinitesimal numbers are similar to the properties of sequences that 
diverge to infinity, are bounded and tend to respectively in standard calculus. They can be summarized as follows. 

Proposition 5 7 j H - oo iJ- ' w 0. 

2) The set *Mi is a subring of the field *R and the set M(0) is an ideal in the ring 

We leave a simple proof of this proposition as an exercise. 

Tlieorem 11) Every a G *Mi has a unique standard part. 

2) The map ° : *Mf, — > R is a homomorphism of a ring *Rj(; onto the field R. 

Proof. The only non-trivial statement is the existence of standard part for any bounded element. Let a G *Rb be 
bounded. Then there exists i G M such that s> a. Consider the set P = {/7 G R | p < o:} C R. This set is nonempty 
since a is bounded not only from above, but also from below. Thus, there exists t = supP in R. If f < a, then 
f + i < a for any n G N. Otherwise supP > f + ^ for some n G N. So, a — f < i for any n G N, i.e. a — r « 0. If 
t > a the proof is similar. □ 

Let (X,p) G § be a metric space. In what follows we write this and similar sentences as "Let {X,p)he a standard 
metric space". Then by the Transfer Principle *S |= {*X, *p) is a metric space. In what follows for any proposition 
<I> instead of writing *S |= <I> we write "<I> in *S. For example, the previous statement may be written as {*X*p) is a 
metric space in *§. 

For any , ^2 G *X we write ^1 « ^2, if > &) ~ 0- ForxeX and ^ e *X v/e write (.^; = st(^ ), if x sa ^ . We 
say in this case that x is a standard part of ^ Obviously, st(^) is defined uniquely. An element of ^ £ *X is said 
to be nearstandard, st(^) exists. In particular, *R.i, is the set of all nearstandard elements of *R. Similarly, the set of 
all nearstandard elements of *X is denoted by *Xi,. For x EX the set E *X \ £, Ri x} is said to be a monad of x and 
denoted by M(x). For an arbitrary < e and x G X let (x) = EX | p ,x) < e}. Then it is easy to see that 

M(x)=n*^iW- (2) 

The simple proof of the following proposition can be found in the books ifTlfTTllgl. 
Proposition 6 Let {X,p) be a standard separable metric space and A C X. Then the following statements are true^ 

1. The set A is open if and only if^x E A M(x) C *A. 

2. The set A is closed if and only ifWx G X (M(x) n *A 7^ x G A). 

^We introduce here the weakest form of the Saturation Principle. However, this form is enough for our goals. 
^For the case of the metric space M we use also the notation ° for the standard part. 

"^These statements are true without the assumption of separability of X, if the nonstandard universe *X satisfies some stronger Saturation 
Principle. 
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3. The set A is compact if and only if it is closed and every element ^ G *A is nearstandard. In particular, X is a 
compact metric space, if and only if every element t, £ *X is nearstandard . 

Proof. To illustrate how the axioms I-V work let us prove that every X compact metric space satisfies the second 
statement of 3). Suppose that X is a compact metric space. The for every n e N there exists a finite set {x\ , C X 

k k 

such that X^ {]Bi (x,). Then, by the Transfer Principle *X = (] *Bi (x,). In other words, G *XV« G n3^^x t, G 

1=1 " ;=1 

*B \_{x) (A). Suppose that there exists ^ G *X that is not nearstandard. It means that 'i^^x ^ M(x), i.e. by formula 

n 

Q ^ ^ fl *Bi (jc). Then, by the Saturation Principle there exists n G *Noo such that ^ ^ *B \ (x), which contradicts 
(A). □ 

iii) This part of Section 2 contains some well-known facts of nonstandard analysis that are necessary only for the 
proofs of results formulated in Section 3. These proofs are contained in Section 4. 

Theorem 2 Let AC *^be an internal set. 

1. IfNCj^, then{Q,l,...,N}CAforsomeN e *Noo. 

2. // *N„ C ^, then *N\{Q,l, ...,n} C A for some NeN. 

3. //M(0) C A, then {~t,t) Q A for some < f G M. 

4. (Robinson 's Lemma) Let (in | « G *N) be an internal sequence such that s„ « far all n G N. Then there exists 
N G *Noo such that s„ « Ofor alln <N 

5. Let {N,i \ n ^ N) be an external sequence of infinite numbers. Then there exists N G *Noo such that N < Nnfor 
all n G N. 

Proofs of the statements 1-4 can be found e.g. in IfTTI . p. 53. 

Proof of the statements. Consider an external sequence of internal sets B„{{n, ...,N„} \ «gN). This sequence 
has obviously a finite intersection property. By the Saturation Principle f] B„ ^ 0. Any element of this intersection 

satisfies the conditions of the statement 5. □ 

We say that a set / C *Noo is an initial segment of infinite numbers if / = {0, ...,A^} H *Noo. 

Theorem 3 Let (a,, | n G *N) be an internal sequence of nonstandard real numbers (elements of *Mj. Then lim °a„ = 
a G M if and only if a^ w a for all L in some initial segment of infinite numbers. 

Proof. Longrightarrow Let lim °fl„ = a G M. For any m G N there exists G N such that the internal set 

n— ).oo 

A,„ ^{k^*^\\ai^-a\<-^} contains all G N such that k > n,„. Then, by Theorem|2](l) there exist Ni„ G *Noo such 
that ...,Nm} CA,„. By Theorem|2](l) there exists G *Noo such that < Nm for all m G N. This A' satisfies the 
conditions of the theorem. 

<^= Let G *Noo be such that w a for all L < A^, L G *Noo. Fix an arbitrary m G N. Then the internal 
set B = {/t G *N I \ak - a\ < j^} D {L e *Noo \ L < N}. Thus, by Theorem |2] (2) there exists n G N such that 
B D {n,...,N} D {keN\k>n}. So, VmG N3n G NV/t G N > n =^ \ °ak-a\ < -. This means that lim = a. □ 

Remark 4 Notice, that the sequence ( °fl„ | n G A^) G S w a standard sequence and, thus, the sequence ( * °a„ \ n G *N) 
is defined. This sequence is not necessarily equal to the initial internal sequence (fl„ | n G *N). The only statement 
that can be claimed is that the entrees of these two sequences are infinite simally close on an interval {0, ...,A^} for 
someNe *Noo. 

Let X be a compact metric space, Y C *X. We say that F is a dense subset of *X, if Vx G X3y G F x ~ y. 
Proposition|6]implies that the last statement is equivalent to the statement Vx G *X3y eY x y. 

IfYCX and X is a metric space, then we say that a function f :Y ^ *K is S'-continuous on Y, if Vyi ,3^2 S F yi ~ 

yi^fiyO^fiyi). 
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Theorem 4 Let {X,p), {Z,d) be standard separable metric spaces, X be a compact space and Y Q *X be a dense 
internal subset of *X. 

1} A function f : X ^ Z is continuous if and only if *f*Xto*Z is S-continuous on *X. 

2) Let F :Y ^ *Zi, be an internal function that is S-continuous on Y, then the function f :X ^ Z defined by the 
formula f{st{^)) — st{F{^)) is a continuous function. 

In what follows the function / defined in the statement 2) of the theorem is said to be the visual image of F, if 
F C*Rx *R. More generally, if A C *M x *R, the the set °A = °b) \ {a,b) e A} is said to be the visual image of 
A. This definition is specific for this paper. Usually, in NSA the set °A is said to be the shadow of A 

Proof. We prove the statement for 1) and the statement for 2). 

1) =>. Since X is a compact space and / is continuous on X, then / is uniformly continuous on X. This means 
that Ve 3 5, Vxi ,X2 GX p (xi ,X2) < 5 =^ d{f{xi),f{x2)) < e is true in S. By the Transfer Principle the statement 

y''e3''8,y^u^2 e *X *p{^u^2) <5=^ V(/(<^,),/(fe)) < e (3) 

is true in *§. If w ^2, then the antecedent of the implication in the statement (|3]l is true for any standard 5. Thus, 
the consequence of this implication is true for any standard e > 0. This means that */(<ri) ~ */(<r2)- 

2) <^=. Due to Proposition |6] (3) the function / is defined correctly. We have to prove that / is uniformly 
continuous on X. By the definition of / it is enough to prove that 

y^'e > 03''5 > 0V<^i,<^2 e Y *p(^i,^2) < 5 =^ *^/(F(^i),^(^2)) < e. (4) 
Fix an arbitrary standard e > 0. Due to the S'-continuity of F, the internal set 

B = {0 < 5 e *R I V^i,^2 e i- *p(^i,fe) < 5 =^ V(F(<^,),^(fe)) < e} 

contains all < 5 w 0. Thus, by Theorem|2](3), there exist a 5 G S such that *(0, 5) C B. This proves the statement 
dl. □ 



iv) We list now the necessary definitions and facts concerning Loeb spaces. We need here only a particular case 
of a Loeb space, namely the Loeb space constructed from the hyperfinite set Y endowed with the uniform probability 
measure. 

Define the internal finitely additive measure on the algebra ^^^^^{Y) of internal subsets of Y by the formula 

' M 

This measure induces the external finite additive measure °jX on 3^™^{Y) 

The Saturation Principle and the Caratheodory Theorem imply the possibility to extend °pL on the c7-algebra 
CJ(^i"^(F)) generated by ^'"^(7). The Loeb space with the underlying setF is the probability, space {Y,Pi{Y),pll), 
where Pl{Y) is the completion of a{I^^^^{Y)) with respect to the extension of °jx and pit is the extension of °/x on 
Pl{Y)- The measure jii is said to be the Loeb measure on Y . If necessary we use the notation We need the 
following property of the Loeb measure that follows immediately from the Saturation Principle. 

Proposition 7 For every set A e there exists an internal set B QY such that iii{AAB) — 0. 

Corollary 2 If A e ^l, then 

PLl{A) = 1 ^ Y'e > 03B e ^""(F) (B CA Afi{B) > I - e) 

Remark 5 The proposition in the right hand side of this corollary is a Nelson-type proposition that will be used as a 
formalization of the notion "almost everywhere in Y" ( "for almost ally €Y "). 

For an arbitrary complete separable metric space R and an external function f : Y ^ R an internal function 
F:Y ->-*Ris said to be a lifting of / if ^L({y e Y \ F{y) w f{y)}) = L 

Proposition 8 A function f : Y ~^ R is measurable iff it has a lifting. 
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An internal function F :Y ^ *]R is said to be S-integmble if for all K E *Noc one has 

^ L l^-WI^O. (5) 

™ {vGF I \F{y)\>K} 

We need the following properties of 5-integrable functions. 

Proposition 9 1) An S-integmble function is almost everywhere bounded. 

2) An internal function F :Y ^ *R is S-integrable iffAv[\F\) — jj \P{y)\ bounded and ^ I^Ij)! ~ 0/or 

yeY yeA 

\A\ 

every internal A C F such that ^ « 0. 

3) An external function / : F — > M w integrable w.r.t. the Loeb measure fli iff it has an S-integrable lifting F, in 
which case 

I fd^L^°Av{F). 

Y 

We address readers to |[T1[TT] for the proofs of Propositions |7] [8] and |9] 



3 Formulation and Discussion of results 

i). In the sake of convenience of the references we recall the formulation of classical G. Birkhoff Ergodic Theo- 
rem.(see e.g (|3]|2l). 

Theorem 5 Let v) be a probability space and T :X a measure preserving transformation and f G Li {X). 
Denote by 

A,{f,T,x) = jY^f{rx). 

Then 

1 ) there exists the function f{x) e Li (X) such that Ai^(f, T,x) — >■ f{x) as °° a.e.; 

2) the function f is T -invariant, i.e. f{Tx) — f(x) for almost all x G X; 

3) !xfdv = !xfdv- 

If y is a finite set, \Y\ = M, then every function on Y is integrable, whatever E and v are. We restrict ourselves 

M 



to the case of the uniform measure: 11(A) ~ for any set A CY. Then any measure preserving transformation 



r : F — y is a bijection and the integral of a function F :Y ^ *R is the average Av{F) = ]g I F{y) ofF. Theorem 

yeY 

|5]is proved very easily in this case. We reformulate it as a statement in the nonstandard universe *§ assuming that F 
is an internal function, F is a hyperfinite set and, thus, M ^ °o. 

For any y EY denote the T-orbit of y by Orb(3') and the period of y by p{y). 

Proposition 10 For any y E Y, ifn^^ p{y)> thenA„{F,T,y)KF{y), where 
Corollary 3 Ifn^M, and T is a cycle of length M, then 



yy^yf{f)^liY^.f{y)=Av{f) 

vex 
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Figure 1 : r(f ) for F defined in Eq|6] 

We leave a simple proof of this proposition as an exercise (see also the proof of Theorem|6]below). 

ii). For the case of M ^ oo it is interesting to study the behavior of ergodic means for « ^ oo but such that ^ ^ °°- 
We start with simple examples. 

Example 1. Let F = {0, . . . ,M - 1 }, T : F ^ 7 is defined by the formula T{y) ^y+l{ mod M) for any y € F. 
Consider the function F : F — > *M such that 



^-'^ 1 -M, ifyis odd. ^ ^ 



Then for any y £Y one has 



M 



0, if n is even, y is any, 



A„{F^ T,y) = — • 1 , if n is odd, y is even (7) 
-1, if n is odd, y is odd. 

Let us plot the set of points {{n / M ,A„{F , T,x)) | n = 0, ...,kM} for any chosen randomly y eY. The first question 
here is how to choose an infinite number M. Recall that the notion of an infinite number is a formalization of a notion 
of a very big number Certainly, the property "to be very big" depends on the problem. Sometimes very moderate 
numbers can be considered as very big. In this example we consider a number M to be very big, if we see the the set 
of points {n/M \n = 0, ...,M} as a continuous segment. On Fig[T]M = 1000 and the randomly chosen y = 698. 

We see on this picture the graphs of two functions y = and y — ^- The first one is the visual image of of the 
set of points A ~ {{n/M,A„{F, T,x)) \ n < M, « is even}, the second one is the visual image of of the set of points 
B={{n/M,A„{F,T,x)) | n <M, « is odd}. 

Indeed, the set A is an internal function, dom(A) ^ Di — {n/M \ \ n < M, n is even} and A(n/M) — 0. The set 
Di is dense in [0,1] and the function A is obviously S'-continuous on Di. By Theorem]?] the function A defines the 
continuous function /. In this case obviously f{t) = 0. 

The set B is an internal function, whose domain D2 — {n/M \ \ n < M, n is odd} and B{n/M) = The set 
D2 is also dense in *[0, 1], but B does not satisfy conditions of Theorem]!] since B{n/M) ^ 00 as n/m ss 0. However, 
for any < a G M the function B restricted to the set D2 H *[a, 1] is 5-continuous. Obviously, its visual image is the 
function f{t) = \/t restricted to the interval [a, 1]. On FigJTJa = 0.15 

In what follows we denote the set {{n/M,A„{FJ,y)) \ < n/M < kM} by Tk{F). We write r{F), if = 1. 

It is natural to ask oneself the following question. 

Under what conditions on an internal function F : F — > *]R the visual image of the set Ti^lF) is the graph of a 
continuous function for any k-^°o and for almost all y EYl 

In view of the above discussion this question can be reformulated as follows. 

Question 1 Under what conditions on a function F : Y ^ *R the ergodic means A„(F,T,y) satisfy the following 
property: 

n ni 

-^-=^A„{F,T,y)^A„iF,T,y) (8) 

for almost ally €Y ? 
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Figure 2: rio(/) 

In investigation of this question we restrict ourselves to the case, when a permutation T : X — > X is a cycle of the 
length M. The general case can be easily reduced to this one. 

Due to Corollary [3] the implication ([8]) holds for every function F :Y ^ *R and every J G if , ~ 00. So, it 
is enough to consider the case of ^ . ^ ^ 00. 

In the following computer experiments, we illustrate that a proposition <I> holds for almost all y e F, by checking 
that this property holds for a randomly chosen y €Y, using computer generator of random elements. As in Example 
1 we use a concrete very big finite set Y , that can be considered as hyperfinite one in our problem. 

The property of S'-integrability of a function on a very big finite space is an analog of the property of integrability 
of functions on infinite probability spaces. It is easy to see that any bounded function F (maxlFfy)! ^ 00) is S- 

yeY 

integrable. The 5-function gives an example of a function F with bounded Av(|F|) that is not S'-integrable. 
Example 2 For the same Y and T as in Example 1 consider the function F :Y —i' *M. given by the formula 

We leave to the reader as an easy exercise to find the formula for A„(F, T,y) for this function F. On Fig|2]we show 
the visual image of the sets rio(/) for M — 1000, and randomly chosen x = 322. We see that the visual image on the 
first picture of Fig|2]is a graph of a function that has points of discontinuity. 

Theorem 6 Let T : Y ^ Y be a cycle of length M. Then for every S-integrable function F :Y ^ *IR,/or every positive 
a S R such that ^ a <C °° and for every numbers K,L ^ °° such that ^ « ^ « a one has Ak{F, T,y) « Ai{F, T,y) 
for all yeY. 

Proof. Assume > L and estimate \AK{F,T,y) — AL{F,T,y)\. It is easy to see that 

\Ak{F, T,y)-ALiF,T,y)\<(j-j) \FiT'y) | + ^ L \FiT'y) \ = U + V. 

\^ ^/ k=Q ^ k=L 



One has 



L-l ([a]+l)M-l 

since f w f w i and ^ \F{T''y) \<j. ^ \F{T''y) \ = [a]Av{\F\) which is bounded due to the 5-integrabiHty 
ofF. 

LetB = {T''y\k = L,...,K-l}. Then ^ = t ~ 0- Thus, ^ I \Fij)\KiO, due to the 5-integrability of F. 



So,y-f 4 I \F{y)\^Oa 



yes 



veB 



The following example shows that this quasi-proposition may fail for the case of very big K, L such that ^ ~ ^ ~ 

0. 

Example 3 Let Y and T be the same as in the previous examples. Fix a number K ^ °o such that K/M « and 
consider the function F :Y ^ *M given by the formula: 
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Figure 3: r{F) for F defined in EqfTOl 



F{k) = I 



1 , mK < k < (m + 1 )K, m < R, m is even 

0, {mK<k< {m+l)K, m<R, m is odd) V RK < m< M 



(10) 



The function F is bounded and, thus, 5-integrable. 

To show that Theorem|6]fails for the set {L ^ oo | ^ « 0} it is enough to prove that Ak{F, T,y) !^A^k-^ {F, T,y) for 
all y in some set of the positive measure ji 

LetD= U {yeY\mK<k<mK+f}. Then, ^z,(D) = f It is easy to see, that Vy G DVn < f ^(^''(y)) ^^(y). 



For every number n <C °° consider the set D„ = {y £ D \ \Ak{F, T,y) — F{y)\ < -}. It is enough to prove that 
lim /ii(D„) = 0. Since the cardinality of the set D„ D [mK, [m + l)K) is the same for all m < R, it is enough to 

calculate the cardinality of E„= D„r] [O, . Since E„ C D, for any y e E„ one has Aj^^j {F, T,y) — F{y) = 1. On the 

otherhand Ajf (F,r,y) = ^ = 1 - ^. So, \E„\ = [f ] and ^l{D„) = {R [!^])/{RK + S) ^ 0. □ 

On Figl3]we see the visual image of the set r{F) for M = 100000, K = 1000 and the randomly chosen y ~ 870722. 

Theorem 7 If Y is a hyperfinite set, \Y\ = M is a very big number, and T : Y ^ Y is an arbitrary permutation, then 
for any S-integrable function F : F — > *R there exists an initial segment I C *N<xi such that for almost all y G Y for all 
L,N € I one has Al{F, T,y) « £i^n{F, T,y). In the case of transitive permutation T one has 



for all N such that ^ « 1. 

The statement of this theorem cannot be seen on the on the picture of r(F), where we see simply some ambiguity 
around the origin. Theorem [T] states, however, that one can always find a number N ^ °° such that the visual image 
of the set of points {{n/N,A„{F, T,y)) \ n = 1,...,N}, is a horizontal line (maybe again with some ambiguity around 
the origin due to numbers « ^ oo) for almost all y e F. In other words, this means that it is always possible to find a 
microscope, such that looking through it on the picture of r{F) around the origin one can always see that the initial 
part of this graph is a horizontal line and we may use one microscope for almost all y G F 

On Fig|4]one can see the visual image of the set {{n/N,A„{F,T,y)) \ n = 1, ...,A^} for the function F of Example 
3 where M = 100000, K ^ 1000, = 0.2K for Fig.4 shows, that OAK does not satisfy TheoremEl 

The proof of Theorem|7]is not elementary. It is contained in Section 4. It is interesting that this proof uses Ergodic 
Theorem and Egoroff's Theorem for infinite probability spaces. One can easily show that any <C in Example 3 
satisfies Theorem|2]. 

The following example shows that the statement Theorem of [T] may not be true for all y G F. 
Example 4. Let F, T be the same as in the previous examples and F{y) = ^. Consider the following function 
\jf : [0, 1]^ ^ R by the formula 



thus. 




(11) 
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Figure 4: r{F) 



Then it is easy to calculate, that 



Another easy calculation shows that for K ^oo such that ^ ~ 0, and for y£{K~M,...M—l} one has Ak {F, T,y)^ 
oo. Obviously fi{{K - M, ...M - 1}) = ^ « 0. 

iii) In this section we introduce definition of approximation of a dynamical system {X, vt) on a compact metric 
space {X,p) with a Borel measure v and a v-preserving transformation T by an internal dynamical system {Y,IJ.,T) 
on a hyperfinite set F, \Y\ = M with a uniform probability measure ji and an internal permutation T :X ^ X. Since 
we consider only the measure on a hyperfinite space we write {Y, T) for the above hyperfinite dynamical system. 
For a set C C X we denote the set {x e X \ 3c £ C p{x,c) < e} by Ue (C). 

Definition 5 1) Let (p : Y ^ *X be an internal injective map such that for every closed set C C X there exists an 
initial segment / C *N such that jx {(p^ ^{U [ { *C))) ss v{C)for all n £ I. Then the pair (F, ^) is said to be a hyperfinite 
approximation (h.a.) of the measure space (X, v). In case ofY C *X and the identical embedding (p we say that Y is 
a h.a. of{X,v). Obviously, any h.a. {Y,(p) is equivalent to the h.a. (p{Y). 

2) Let T : X ~^ X be a measure preserving transformation ofX and (F, (jd) be a h.a. of v). Then we say that an 
internal permutation T : X X is a h.a. of the transformation T if for almost ally £Y one has (p(T{y)) t(^(3')). 
We say also that the internal triple (Y, T, 0) is a h.a. of the dynamical system {X, V, t). 

Proposition 11 A pair (F, (p) is h.a. approximation of {X,v), if the map sto (pY ^ X is a measure preserving map 
with respect to the measure V and the Loeb measure }Xl. 

Proof By Proposition|4]the condition of Definition |5](1) is equivalent to the following condition 

v{C)^\tm°^{^-\*U^{C))). (13) 

£->-0 

It is easy to see that, if C is a compact set, then f] U i{*C) ~ st"'(C). Using this fact and the equahty (flJl l one 

obtains the equality v(C) = (st"' (C))). □ 

Let / G Li (v) and F C *X be a h.a. of {X, v). Restrict the function st : *X -> X on the set F. Then PropositionfTT] 
shows that st is a measure-preserving map and, thus, /o st e Li (Ml)- Due to Proposition|9l3) ^ost has an 5-integrable 
Ufting F. We say in this case that F is an 5-integrable lifting of the function /. In this case 

Av{F) = f FdpLL = / fdv. (14) 

JY Jx 

Proposition 12 If f e C{X), then *f \ Y is an S-integrable lifting off. 

Tfieorem 8 Let v be a non-atomic Borel measure on a compact metric space X such that the measure of every ball 
is positive. Then 

1. for every set A(-X such that v(A) — 1 there exists a hyperfinite set F C *A such that Y is a h.a. of v). 
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2. For every dynamical system (X, V, t) and for every h.a. Y of {X,v) there exists a h.a. (F, T). Moreover, one 
can choose a h.a. T of X to be a cycle of the length M. 



The proof of this theorem is contained in Section 4. 

In what follows a F-cycle of the length M is said to be a transitive permutation of Y . 

Example 4'. Returning to Example 4 above define the map (j? : F — > [0, 1] by the formula <p{y) = ^. Then, 
obviously, the pair {Y,(p) approximates the probability space {[0,1], dx), where dx is the Lebesgue measure. The 
permutation T approximates the identical map id : [0, 1] ^ [0, 1]. Indeed, for ally 7^ M — 1 one has id{(p{y)) — j{y) = 
^ w ii- — (p{T{y)). Thus, Y, (p, T and T — id satisfy Definition |5] The function F of Example 4 is a lifting of the 
function g{x) — x 

Proposition 13 Let {Y, T) be a h.a. of{X,v,T), f £ L\ (v), / = lim A„(/, T,x) and let F be an S-integrable lifting of 



This proposition follows immediately from Theorem|2l 

Corollary 4 Let T be a transitive permutation and let X be a non-ergodic transformation. Consider a function 
f £ Li{v) such that the set B C X of all x € X satisfying inequality lim A„(/, T,x) ^Av{f) has a positive measure V. 

Then there exist infinite M-boundedN ,K such that for almost all y £ st^^{B) one has Aff{F, T,y) ^ Af^{F, T,y). 

Proof . Let / = lim A„(/, T, •) and F be the same as in Proposition [T3] By this proposition there exists £ *Noo 



such that ^ K Q and Afj{F,T ,y) Ki F iy) ^L-a.e. Thus, Aiv(F, T,}/) 9^Ay(/) for ^^-almost all y e st"' (B). 

On the other hand, since T is a cycle of length M, by Theorem |6] one has Ak{F, T,y) « Av{F) « Av{f) for all 
y e F and for all K such that f « 1. Thus, Ak{F, T,y) 9^ Am{F, T,y) for ^/.-almost all y £ st"' (B). □ 

Proposition shows that if {Y, T) is a h.a. of a dynamical system {X, v, t), t is a non-ergodic transformation and 
r is a transitive permutation, then there exists a function f £L\ (v) an internal set B <£Y, ll{B) ^ and K,L £ *Noc 
such that Ak{F, T,y) 56 Ai{F, T,y) for all y £ B, where F is an S'-integrable lifting of /. 

Corollary 5 If under the conditions of the previous paragraph, for any f £ Li{jl) for almost all y £ Y and for all 

N £ *Noo one has 



then X is an ergodic transformation 

We do not know, wether the sufficient condition of the ergodicity of T formulated in Corollary|5] is also a necessary 
condition. By Proposition[T3]the approximate equality (fTSl l holds for all in some initial segment / C *Noo for almost 
all y G F for an ergodic transformation T or for any transformation T and transitive permutation T, if ^ w n e N or, if 
^ ~ cx) (see TheoremfToli. 

This and even stronger is necessary for uniquely ergodic transformations. Recall that a continuous transformation 
T : X — > X is said to be uniquely ergodic if there exists only one T-invariant Borel measure on ^(jfl 

Theorem 9 If X is a uniquely ergodic transformation of a compact metric space X, Y £- *X is a hyperfinite dense 
subset of *X, and T : Y ^ Y is an internal permutation such that Vy S F st{T{y)) — x{st{y)), then for every y £Y 
such that the X-orbit of st{y) is dense in X, for every N £ *Noo and for every f £ C{X) one has 



f, then there exists an initial segment I C *Noo, such that for almost ally £Y 



\fK£lAN{F,T,y)^F{y)^f{y). 




(15) 




(16) 



X 



where V is the X-invariant measure. 



^Krylov-Bogoljubov theorem claims the existence of at least one T-invariant measure. 
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Figure 5: r{F) for transformation t(x) —x + 2/3 mod 1 



Figure 6: r(/) for transformation t(x) = x + 1 /\/2 mod 1 



The proof of this theorem is contained in Section 4. 

Example 5. In this example we consider a hyperfinite set Y = {0, 1, ...,M — 1} and a permutation T .Y ^ Y 
given by the formula T{y) ^ y + P modM. We choose P and M to be relatively prime, so that T is a cycle of 
length M. The approximation {Y, (p) of the probability space ([0, used in Example 4' can be used as well for 

the probability space ([0, l),dx), where [0, 1) is provided by the topology of the circle. For any f G R the measure 
preserving transformation T : [0, 1) — > [0, 1), such that T{y) ^ y + t{ mod 1) is called the f-shift of a circle. This 
transformation is continuous on [0, 1). It is easy to see that if ^ w f , then the triple (Y,(p,T) approximate the shift T. 
We present the visual images of r{F) for F — f \ (p(Y), where 



We choose the function / that is close to the function = x, considered in Example 4' . However, / is continu- 
ous on the circle [0, 1), while g is discontinuous at jc = 0. We consider two cases. 

a) . On Fig|5]the visual image of r(F) on the interval [0, 1] and at the neighborhood of are presented for the case 
of M = 33334, P = 22225 and the randomly chosen y = 16667. 

b) . On Fig|6]we see the visual image of r(/) on the interval [0, 1] and at the neighborhood of are presented for 
the case of M = 25001, P ~ 17677 and the randomly chosen y = 6119. In this case (F, (p, T) approximates 1 / V2-shift. 
In accordance with Theorem|9]this visual image is a horizontal line. 

To explain the difference in the graphs in the cases a) and b) notice that in the case a) ^ |. Actually, | ^ — f | < 
0.00046 that is enough for our problem to consider these numbers to be infinitesimally close (see the discussion in 
the Example 1). In this case x = ^ = ~ 0.5 and x{y) —y+'\{ mod I). It is easy to see that for 5 < y < | one 
has ^{y) — \ ['^{y — \ /3) + ^{y) + ^{y + I /3)] (for any integrable function (p). So, in our case ^(0.5) « 0.56. We 
see that the value of the function on Fig. 5 at the neighborhood of is close to 0.56 that agrees with Proposition [T3] 
Since T is a cycle of length M the value of the function on Fig. 5 at the neighborhood of 1 is close to Av{ f ) = Av{(p \ 
j{X)) « /q (pdjx by Definition |5] In our case /q (pdx — 0.5. The visual image of r(/) is a continuous function on 
[0, 1] in accordance with Theorem|6l 

In case b)^w-^(|^— -^|< 0.00006). So, in this case T approximates irrational shift of the circle [0, 1). It is 
well-known that irrational shifts of the circle are uniquely ergodic transformations. Since 9 is a continuous function, 
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AK{f, T,x) w 0.5 for all A" ^ oo by Theorem|9l Thus, the visual image of r(/) is the horizontal line y = 0.5, that is 
perfectly reflected on both pictures of Fig|6] 

The consideration of these two examples arises the following question. Suppose that we have a ratio ^ of two 
relatively prime numbers. In what case this ratio can be considered as "practically" rational number and in what 
case one should consider it as "practically" irrational number. Using the informal language of the Introduction one 
can say that that ^ is "practically" rational, if there exist two natural numbers m,n <^ o° such that ^ ~ 7, and ^ is 
"practically" irrational otherwise. Certainly the exact answer strongly depends on a problem, in which we need to 
answer this question. However, the statements of this section provide us with some qualitative understanding of the 
correlation between the behaviors of very big discrete systems and their continuous approximations, (or vise versa, 
continuous systems and their discrete approximations). 

Example 6. (Approximations of Bernoulli shifts). Let E„j = {0, 1, . . .m — 1}. Consider the compact space X = E,f, 
with the Tychonoff topology. Let a be a function, such that dom(a) C Z is finite, and range(fl) C E„,. Let Sa = {/ G 
X \ f \ dom(fl) = a}. Then the family of all such Sa form a base of neighborhoods of the compact space X. For g E *X 
set f = g \ Z, then f GX and it is easy to see that / = st(^). 

The continuous transformation T : X —i' X defined by the formula T{f){n) ~ f{n + 1) where f E X and n e Z 

m— 1 

is an invertible Bernoulli shift. Every probability distribution {po, . . . ,p,„-i} {p, > 0, ^ pi — 1) on E„, defines a 

1=0 

Borel measure on X that is obviously invariant with respect to T. It is well-known that T is ergodic for each of these 
measures. So, the transformation T is not uniquely ergodic. Here we restrict ourselves only to the case of the uniform 
distribution on Em, i.e. to the case of po ~ ■ ■ ■ = Pm-i = j;;- The corresponding Borel measure on X is denoted by v. 

Obviously, v{Sa) = m-\^°^^"^\. 

We construct here two hyperfinite approximations of the dynamical system {X,v,t). First we consider the 
straightforward approximation by a hyperfinite shift. Fix G *N„o and set Y = E,^,, Then M = \Y\ = m^^+'. 

Define X :¥ ^ *X as foUows. For y G E,ir^ set 

^W(") = |o, |«|>A^ ^^^^ 

Then sto X{y) ~y \ 7.. Thus, for every standard neighborhood Sa defined above one has {stoX)-^{*Sa) = {y€Y\y\ 
dom(fl) =fl}. So, ^z.((stoA)-'(*5„)) = v(5„) = m-^^o^W. This proves that {Y,X) is ah.a. of{X,v). 

Certainly, an arbitrary internal map from Y to E,„^^^ n,...m} used to define the values X{y){n) for |n| > 

and y G y in the definition of X SvH 

In what follows we use notations yi w y2 and st(3') for X{yi) sa X{y2) and st(A(y)) respectively. 

Define the map S Shy the formula 5 (}')(«) =y{n + l{ mod 2N + 1)) for any y G Y and n G {— A^, . . . ,A^}. Then 
obviously T(st(3')) = st(5()')) for all y GY. So, {Y,X,S) is a h.a. of the dynamical system {X,v,t). 

Since every point y G F is {2N + l)-periodic with respect to S the permutation S is not transitive. Though the 
existence of a transitive h.a. of T is proved in Theorem[8] it is not easy to construct such approximation explicitly. 

To do this we reproduce here the construction of de Bruijn sequences. 

Delinition 6 An {m,n)-de Bruijn sequence on the alphabet is a sequence s — {sq,si,. . . ,sl_i) ofL — m" elements 
Si G Em such that all consecutive subsequences . . . of length n are distinct. 

Here and below in this example the symbols ® and denote + and - modulo L, so that the sequence s is considered 
as a sequence of symbols from E„ placed on a circle. 

It was proved [I4ll5| that there exist (ml)'"" ' • m^" {m,n)-de Bruijn sequences. See also |6 | for a simple algorithm 
for de Bruijn sequences and more recent references. 

To construct a transitive h.a. T : F — ^ F of T fix arbitrary (m, 2N + 1 ) de Bruijn sequence s — {so,si, . . . ,sm-i) here 
L = M. Let y = {y-N, ■ ■ ■ ,y-N) € Y. Then there exists the unique consecutive subsequence a{y) — (s,, , . . . , s,©2Ar) 
such that = Set P(cT(y)) = . . . ,Si®27Vffii) and T{y) = a-^{P{a{y))). Notice that if i<M-N , then 

for all j <N one has S;©,©Ar = Sj+i+Af. So, T{y)j = yj+i for all j < N and, thus, for all standard j. This last equality 
implies that st(r(3')) = T(st(3')) for all y G F such that the first entry of the sequence a{y) is the i-s term of the initial 
de Bruijn sequence for / < L-2A^ — L So, Ml({3' I st(r(y)) = T(st(y))}) > « L This proves that T is a h.a. of 
T. We call r a de Bruijn approximation of T. 



16 



It is interesting to study the behavior of ergodic means of described approximations. This problem will be dis- 
cussed in another paper We confine ourselves with two simple remarks. 

1 . If (7(y) = (i,-, . . . , 5,+2iv> and i<M-N, then A„ (F, T,y) ^ A„ {F, S,y) for all n<N. 

2. Let Sq ~ {f £ X I /(O) = 1}, so that v(5o) = j and let Xo be a characteristic function of So- For y e F let 
/ = st(y). SetA(3;) =/-i({l})nN. Recall that the density of A(y) is given by the formula 

.(AW)=iim l-^Wn{o,-,^-i}l 

m^oo ffi 

It is easy to see that for m < N one has 

m 

So, for all y e y such that the density d{A{y)) exists one has 3Ke *N«, Vm G *Noo m < K=^A,„{xo, T,y) « d{A{y)). 
Due to PropositionfTD there exist K G *Noo such that for jU^-almost ally G F one has A„,{*Xo,T,y) w j. 

iv) (Formulation of results in the framework of the standard mathematics.) While in nonstandard analysis we use 
the notion of an infinite number (hyperfinite set) as a formalization of the notion of a very big number (finite set), in 
classical mathematics we use the sequences of numbers (finite sets) diverging to infinity to formalize these notions. 
For example, in previous sections we considered a hyperfinite set Y and its internal permutation T : F — > F. If we 
want to treat the same problems in the framework of standard mathematics, we have to consider a sequence (7„,r„) 
of finite sets Y„ whose cardinalities tend to infinity and their permutations T„. Similarly, internal functions F : F — > *IR 
correspond to sequences F„ : F,, — > M in standard mathematics. 

First, we discuss what property of such sequences correspond to the property of an internal function F to be 
5-integrable. The following proposition gives a reasonable answer to this question. 

Proposition 14 Let Y„ be a standard sequence of finite sets, such that \Yn\^ M„ °° as n ^ °°. Then for an arbitrary 
sequence F„ : X„ — !■ M the following statements are equivalent: 

1. For every K G *Noo the function *Fk is S-integrable. 

2. 

1™ L i^;wi = o (18) 

The proof can be obtained easily from the definition of 5-integrable functions (|5]l using arguments similar to those 
that were used in the proof of Theorem[3] 

A sequence F„ that satisfies the statement (2) of Proposition[T4]is said to be uniformly integrable. 
Proposition[T4lleads to establishing the standard version of Theorem|6l 

Proposition 15 In conditions of Proposition [74] let Tn'-Y^ ^ Y^ be a sequence of transitive permutations and F„ : 
F„ R be a uniformly integrable sequence. Consider two sequences of natural numbers K„ and L„ such that ^ is 

bounded, Uminf ^ > and lim = 1. Then the following two statements are true. 



1. For any e > one has 



]im^-\{yeY„ \ \AK,XF„,T„,y)-AL„{Fn,Tn,y)\>e}\^0 (19) 



2. . IfT„ is a sequence of transitive permutations or F„ is a sequence of bounded functions, then 

lim max \Ak„ {F„ , T„ , y) ~ Al„ {F„ Jn,y)\=0 (20) 
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It is not too difficult to rewrite the proof of Theorem |6] in (standard) terms of Proposition [15] It is also easy to 
deduce PropositionfTSjfrom Theorem |6] using arguments close to those of the proof of Theorem[3] 

The rigorous interpretation of Theorem [T] in the framework of standard mathematics is much more difficult. To 
formulate the corresponding rigorous theorem, we need to remind the notion of an ultrafilter and of the limit of a 
sequence over a non-principle ultrafilter 

Recall that a subset ^ C ^(N) is said to be a non-principle ultrafilter, if ^ = {A C N | m(A) — 1} for some 
finitely additive measure m on ^(N) that assumes only two values and 1 such that m(B) = for any finite setfi C N 
and m(N) = 1. For a sequence a : N — !• R we say that lima = L, if for any e > the set {« e N | |a(«) — L| <e} 

It is known that any bounded sequence has a limit over any non-principle ultrafilter For two sequences a , j3 : N — > K 
we say that a j3 iff {n e N | a{n) < j3(«)} e ^. 

Proposition 16 Let T„ : Y„ Y„ be a sequence of arbitrary permutations. Then for every non-principle ultrafilter 
C ^(N) there exists a sequence K„ o° as n ^ °° and a sequence A„ C Y„ such that lim — and for any 

L„ -^ooasn-^oo, if{L„) {K„), f/zen lim(A/s:„ (/„, r„,x„) - A/.,, (/„, r„,x„)) =0. 

This proposition doesn't have such intuitively clear sense as Theorem]?] One hardly can find a proof of it, that 
doesn't use the ideas of nonstandard analysis. 

To formulate the standard version of Definition|5]introduce the following notation. Let Z C X be a finite subset of 
X and 5z = 4t L where 5z is a Dirac measure at a point z'EZ, i.e. 5z is a Borel probability measure such that for 



Definition 7 In conditions of Definition \5\ let {¥„ \ n € N} be a sequence of finite subsets of X. We say that the 
sequence Y„ approximates the measure space v) if the sequence of measures 5y„ converges to the measure V in 
the *-weak topology on the space ^{X) of all Borel measures on X. 

The following proposition follows easily from well known theorems of functional analysis. 

Proposition 17 In conditions of Definition^suppose that every open ball in X has the positive measure V and every 
set of the positive measure V is infinite. Then for every set A C X with v(A) = 1 there exists a sequence Y„ of finite 
subsets ofX approximating the measure space v) such that^n € N Y„ Q A. □ 

Definition [T] can be considered as a standard sequence version of Definition |5](1). This statement is based on the 
following 

Proposition 18 A sequence Y„ C X approximates a measure space {X, v) in the sense of Definition\7\if and only if 
for any N € *Noo the set Yn is a hyperfinite approximation of the measure space v). 

Proof. Let Y„ approximates {X,v) and e *Noo. Then for any / e C(X) one has 



The first equality is due to */ is a lifting of /o st. The second follows from Definition [T] and from the nonstandard 
analysis definition of the limit of a sequence. Now st : Fa? — > X defines a measure v' on X that is the image of the 
Loeb measure of Y . Due to (ISTT i and the Riesz representation theorem v' — V. 

<;= Assume that st f Fa? : yjv M is a measure preserving transformation for every e *Noo. It is easy to see that 
for every function / e C{X) the internal function */ f Fat is a lifting of /. So, 




z e A. Obviously, for any function / e C{X) one has 





(21) 




fdv. 
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Thus, the equaHty (ISTT i holds for every e *Nc» and by the nonstandard analysis definition of a limit one has 

Um / fdSy,, = ffdva 

The last two propositions imply TheoremfSfl). 

We use the same approach as above to formulate a sequence version of the notion of a hyperfinite approximation 
of a dynamical system. 

Definition 8 Let {X , p) be a compact metric space, V be a Borel measure on X, X : X ^ X be a measure preserving 
transformation ofX, {Y„ <ZX \ n Cz N} be a sequence of finite approximation of the measure space (X, v) in the sense 
of Definition^and T„:Y„^ ¥„ be a sequence of permutations ofY^. We say that a sequence T„ is an approximating 
sequence of the transformation X if for every N € *Noo the internal permutation Tn '-Yn ^ Yn is a h.a. of T in the 
sense of Definition\5\ In this case we say that the sequence of finite dynamical systems (Yn,ll„,T„) approximates the 
dynamical system (X, V, t). Here jln is a uniform probability measure on Y„. 

The reformulation of this definition in full generality in standard mathematical terms is practically unreadable. 
However, it is easy to reformulate it for the case of an almost everywhere continuous transformation T. This case 
covers a lot of important applications. 

Denote the set of all points of continuity of the map T : X — > X by D^. 

Lemma 1 Supposethatv{Dx) — \andletY^Xbeah.a. of the measure space {X ,v). Then a permutationT :Y ^Y 
is a h.a. of the transformation T if and only if for every positive e g M one has 

^(|{yey I p(r(y),My)) >£}!)« 0. (22) 

Proof Let A = {yeY\ °y e D.,} = st-^{Dr), B = {y eY \ T{y) sa T{°y)}. Then, ^z, (A) = 1 since F is a h.a. 
of the measure space {X,v) and v(Dt) = L Since T is a h.a. of T, one has IJ.l{B) = 1. Thus, /Xi(A nZ?) — I. Since T 
is continuous on one has 

yx e X °x e Dt: =^ *x{x) K xi°x). (23) 

So, Vy e A nB *T(y) « T(°y) and thus, Vy G A *T{y) w T{y). So, for every positive e e M one has {y e 
Y I p{T{y), *T{y)) > e} C F\ (ARB). This proves 

(4=) Suppose that (|22li holds for every positive e G M. Then obviously IJ.L{{y e Y \T{y) w *T:{y)}) = 1. On the 
other hand, by ^ one has ^z,({y e Y \ *T{y) w T(°y)}) 1. Thus, ^z,({y € Y \ T{y) w T(°y)}) = 1, i.e. T is a h.a. 
of T □ 

Lemma[T|implies immediately the following 

Proposition 19 (Standard version of Definition |8) In conditions of Definition\8\and Lemma\J}the sequence of per- 
mutations T„ :Y„ ^ Y„ is an approximating sequence of the transformation X if and only if for every positive £ G M 
one has 

lim-^(|{3;ey„ |p(r„(3;),T(3')) >e}|)=0. □ (24) 

Now we are able to prove the sequence version of Theorem [8] (2). 

Tlieorem 10 Let (X,p) be a compact metric space and V be a Borel measure onX such that the measure space (X, v) 
satisfies the conditions of Theorem^ Then for every measure preserving transformation T : X ^ X with v(Dt) — 1 
there exist a sequence of finite sets Y„ QX and a sequence of permutations T„ : Y,, — > Y„ such that the sequence of 
finite dynamical systems {Y„,T„) approximates the dynamical system (X, V, t) in the sense of Definition^ Moreover, 
one can choose transitive permutations T„. 

Proof. Let y„ C X be a sequence that approximates the measure space (X, v) in the sense of Definition [T] Such 
sequence exists by Proposition [Tt] Then by Proposition [TS] for any e *Noo the set Y^ is a h.a. of the measure space 
{X,v) in the sense of Definition|5] By Theorem[8]there exists a (transitive) permutation Tn '.Yn ^ Yn that is a h.a. of 
the transformation T. By Lemma[Tl since v(Z)t) ~ 1, this means that {Yn, Tn) satisfies (l22l i for every standard positive 
e. In this proof the letter T maybe with lower indexes always denotes a (transitive) permutation. 
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For every numbers n,m G N define the set 



keN \ 3T -.Yk^Yk 



1 



{yey, |p(r(y),T(y))>-} 



< 



Since VA^ G *Noo G *A„.„„ there exists a standard function N{n,m) such that VA: > N{n,m) k G A,,,,,,. By the 
definition of sets A„,.„, there exists a standard function T{k,n,m) : Yk — > Yk with the domain {(n,m, k)en^ \k> 
N{n,m)} such that 



1 



y(^Yk\p{n{y)My})>- 



< 



Now it is easy to see that if r = N{n,n) +n, then the sequence (F, , Tr) satisfies the conditions of Proposition[T9l □ 
This proof is based on NSA. The purely standard proof of this theorem seems to be much more difficult. 



4 Proofs of Theorems S M.2) and E 

i) (Proof of Theorem^). We notice first, that the following proposition follows immediately from Theorem|5] applied 
to the external dynamical system {Y,ij.l,T) and Theorem[3] 

Proposition 20 In conditions ofTheorem\6\for any y G F there exists an initial segment I C *Noo such that 

\fL,KeI {AK{F,T,y) ^AL{FJ,y) « \imA„{°F,T,y)). 

Proposition l20l is a weaker version of Theorem |7] since it differs of this theorem only in the order of quantifiers 
"for all y G r and "there exists an initial segment / C *Noo". 
To prove Theorem|2]first it is necessary to prove 

Theorem 11 Let /„ : F — > M, n CzN be a sequence of jXi measurable functions on Y, and F„:Y *M, n G *N be an 
internal sequence such that Vn G N, F„ is a lifting of f„. Then f„ converges to a measurable function f ^^-almost 
everywhere if and only if there exists K G *N<jo such that jli-altnost everywhere VA^ G *Noo, N < K Fn{x) « F{x), 
where F is a lifting of f. 

Proof of TheoremfTT] 

(=>) Let /„converges to / a.e. By Egoroff 's theorem 

V/t G NBBk C Y {u.L{Bk) > 1 - - A/„(x) = °FJx) converges uniformly on Bk). 

k 

WLOG we may assume that Bj^ is internal, ^ > 1 — |-, and \fn,k G NVx G B;^ Fn{x) « fn{x) and « f(x)- Then 

3^V* : N ^ NV-"rV^^7t > 9^(r)max |F„(x) -F(x)| < -. 

xeBt r 

Consider the internal set 

C^.={Ne *N I \/m{N > m >(pk{r) =^yx e Bk \F„r{x) - F {x)\ < i)} 

The previous statement shows that contains all standard numbers that are greater that (Pk{r)- Thus, there exists 
infinite A^f G C^. By Theorem|2](5) 3K G *NocV^^fc,r/: < N^. Obviously, this K satisfies Theoremfll] 

(<^) Let B = {x G F I VA^ G *Noo N < K =^ Fn{x) « F(x)}, A„ = {x G F | f„{x) « F„{x)}, n G N, A = {x G 

F I c^BnAn n A„. 

nefi 

By conditions of the theorem (C) = 1 . Fix an arbitrary jc G C, and an arbitrary r G N. The internal set D = {« G 
*N I \F„{x) ~ F{x)\ < i} contains all infinite numbers that are less or equal to /T. So 3«o G NVn > no \Fn{x) — F{x)\ < 
i}. Since F„(x) « fn{x), the same holds for f„{x) and °F{x). Thus, /„ converges to / = °F a.e. □. 
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Now we are able to complete the proof of Theorem |7] In conditions of Theorem |2] let / = °F and /„ (x) = 
A„{f,T,x), n e N and the internal sequence =^n(^',7',-^), *N. Then f € L\{^l) and /vi is an 5-integrable 
lifting of /„ for all n G N. By Theorem|5]/„ converges to an integrable function / a.e. Let F be an S'-integrable lifting 
off. Then by TheoremOthere exists K e *Noc such that jU£-almost surely 'iN e *noo N < K =^ Fn{X) F{x) □. 

ii) {Proof of Theorem^(2).) It is well-known (see e.g. |I3]|2|) the measure space (X, v) is a Lebesgue space, i.e. it 
is isomorphic modulo measure to the measure space ([0, 1],c/;k;), where dx is the standard Lebesgue measure. This 
means that there exist a set B C X a set C C [0, 1] and a bijective map y/ . B such that dx{C) = v{B) = 1 and the 
maps \f/^^ are measure preserving. 

Lemma 2 In conditions of the previous paragraph let Y be a h.a. of {X, v)). Then for every set D C [0, 1] with 
dx{D) ~ 1 there exists a bijective lifting G : F — > *[0, 1] of the map \j/ such that 

1. Z = G{Y) C *D; 

2. Z is a h.a. of {[0,1], dx). 

3. G^^ :Z ^ *X is a lifting ofyr^^. 

Proof. Let F :¥ ^ *[0, 1] be a lifting of xj/. Let a = 5min{p(M,v) \ u,v £ F{Y), u ^ v}. Then < C7 w and 
Vm e F(Y) Baiu)nF(Y) = {u}. Since *v{B(,{u)) > and dx{D) = 1 the set B(,{u) n *D contains infinitely many 
points, and thus, there exists an internal set C B(j{u)r\ *D such that \Eu \ = \F^^{u)\. Establishing bijection between 
F^' (m) and E„ for every u £ F(Y), we obtain the bijection G : F — > Z C *D that is a lifting of Xj/. Notice that since G 
and are bijections they are measure preserving maps between measure spaces {¥,1x1) ^^'^ (^iMl)- 

To prove the second property of the set Z, one needs to show that ifpij |^ Z : Z — > [0, 1] is a measure preserving 
map, i.e. that for every measurable set AC [0,1] one has 

Mf(sf[o'i](^)nZ)=^/x(A) (25) 

One has 

(^f[o'i] iA)nZ) = ^[{{y £ Y I G{y) £ st^^\^ (A)}) = ^[{{y £ Y \ °G{y) £ A}). (26) 

Since G is a lifting of on has °G{y) ~ \i/{stx{y)) for /x^-almost all y. Thus, 

^l{{y£Y\°G{y)£A})^fil{{y£Y\xif{stx{y))£A})^v{w-\A))^dx{A), (27) 

since stx [ Y : Y ^ X and y/ . B ^ C C [0, 1] are measure preserving maps. The equality (l25T l follows from the 
equalities ( l26l ) and dZTl i. 

To prove the third property of the set Z it is enough to show that stY{G^^ {zj) ~ 'Z^' (sf[o.i] {z)) for /i^-almost all 
z £Z. Since yris a bijection, the last equality is equivalent to the equality (G^'(z))) ~ ifp.i] (z), which follows 
from the following sequence of equalities that hold for /i^-almost all z£ Z: 

xi/{stY{G-Hz))^st[0A]iG{G-\z)))^st[0A]iz).O 

The proof of Theorem[8l2) is divided in six parts I - VI. 

I. Here we prove the existence of a h.a. {Y,pLi,T) of the dynamical system ([0, \ ],dx, t). Let Y be an arbitrary h.a. 
of the measure space ([0, \],dx). Let F : F — > *[0, 1] be a lifting of T. First we prove the following statement. 
(A) For every standard 5 > there exists a permutation :Y ^Y such that 

\{y^Y\\F{y)-Ts{y)\<5}\ ^^^ 
M ^ 

We deduce (A) from the Marriage Lemma. Fix a standard 5 > and for every y e 7 set S{y) = *{F{y) — 8,F{y) + 

5) n Y. Let / be an arbitrary internal subset of Y. Set S{I) = U S{y) and B{I) = [j *{F{y) - 8,F{y) + 8). So, 

yei yei 

S{I) = n Y. The internal set B{I) can be represented as a union of a hyperfinite family of disjoint intervals. Since 

n 

the length of each of these intervals is not less than 25, their number is actually finite. Let B{I) = [j {£,j, Tj,), where 

i=l 

intervals {£,j, 77,) are pairwise disjoint and n is standard. 
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Consider the standard set C = U %)■ Then dx{C)HL{st'\*C)). Obviously, st-i(*C)AB(/) C IJ (M(°^,) U 

1=1 1=1 
= M{dC), where the monad of a number a e [0, 1] is denoted by M{a). Since the Loeb measure of the 

monad of any number is equal to and so, M(dC) ~ 0, one has dx{C) — ° {^^^^^ ■ Substituting [0, 1] for X, dx for 

V and T for \if in ^ obtain <ix(C) ^dx{T-^{C)) = A^il^^Hst^'lC))). Since /\ F"' (st"' (C)) C M{dC), one has 

- ° f ^) ■ This means that if r/ = max{0, |/| - \S{I)\}, then ^ sa 0. Let r = max{r/ | / C F}. Fix an arbitrary 



setZC *[0,l]\Fsuchthat|Z|=r.Forevery3;GFset5'(y)=5(y)UZandforanarbitrary/C}'set5'(/)= U S'{y). 

yeY 

Then S'{I) = S{I)UZ, \S'{I)\ = \S{I)\+r> |/|, since |/| - \S{I)\ = n < r. By the Marriage Lemma there exists an 
injectivemap : 7 ^ ^X^) = J'UZ such that Vy d{y) eS'{y). Obviously = \Y\9{Y)\<r. So, there exists 

a bijective map A : 0"' (Z) ^ 7 \ e{Y). Define Tg-.Y ^Yhy the formula 



Tsiy) 



9{y), yeY\d-\Z) 
X{y), ye (Z) 



Notice that ^-^-j^^ < jj- By construction of Tg one has \/yeY\ 0-'(Z) \Ts{y) - T(y)| < 5. Since (Z)) < 

]g « 0, the statement (A) is proved. 

Let S^{Y) be the set of all internal permutations of Y. Consider the external function f : N ^ (Y) such that 
/(«) — Ti. By the Saturation Principle the function / can be extended to an internal function / : {0, . . . ,K} S^{Y) 

for some K £ *Noo. Internal function g{n) ~ ^^""^^ ^ ^^^"^ /(3')l>„}| ^ggmj^es only infinitesimal values for all standard n. 
By Robinson's Lemma there exists L e *N«, such that g{L) « 0. set T = f{L). Then ^L{{y e Y \ T{y) sa F{y)}) = 1. 
Since F is a lifting of T, the same is true also for T{y). This proves I. 

We have to prove now that a h.a. T of T can be chosen as a cycle of maximal length. 

II. Fix a permutation T : 7 — > F that is a h.a. of T and represent it by a product of pairwise disjoint cycles, including 
the cycles of length 1 (fix points): 

T = iyu--yi„i){y2i--y2n2)--{ybi--ybnt), (28) 

where yij G 7 is the y'-th element in the i-th cycle and b is the number of cycles. So, 

b 

£«,-=M=|F|. (29) 

1=1 

We assume also that «i > n2 > • ■ ■ > Consider the cycle 

C= (3'ii---3'ini3'2i---3'2«2---%i---%«J (30) 

By ( [29b C is a cycle of length M, i.e. a transitive permutation. 

SctB^{yeY\Ciy)y^Tiy)}. 

M 

|B|=Z7=£a„, (31) 

n=l 

where a„ is the number of cycles of length n. 

III. Recall that a point x £ [0, 1] is said to be an «-periodic point of the transformation T if its orbit under this 
transformation consists of «-points: x, Tx, . . . , t"^^x. A point x is said to be T-periodic if it is «-periodic for some 
n. The transformation T is said to be aperiodic if the set of periodic points has measure zero. It is well-known that 
every measure preserving automorphism T of a Lebesgue space X defines the partition of this space by T-invariant 
Lebesgue subspaces of aperiodic and ^-periodic points. So, it is enough to prove our statement for the case of 
aperiodic transformation T and for the case of n-periodic transformation T. 

Suppose that the transformation T is aperiodic. Let us prove that under this assumption the cycle C defined in the 
part II is a h.a. of T. 

Let f„(r) C y be the set of all n-periodic points of T and let P„{t) C X be the set of all n-periodic points of T. 
Since T is a lifting of T it is easy to that for every standard k the following relations 

T{y)^zry),...J>^{y)^T'ry) (32) 
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hold ^L-a.e. on Y. So, for every standard n Pn{T) C if '(f„(T)) up to a set of the Loeb measure zero. Since 
dx{P„{T)) ~ 0, one has j^\Pn{T) \ ~ 0. Obviously, |-P„(r)| = na„. Thus, for every standard n one has -g - An 0. By the 

Af M M 

Robinson's Lemma there exists an infinite such that ^ ^ a„ w 0.. Obviously M > ^ a„-«>(A^+l) ^ fl„. 

n=l n=Af+l n=Af+l 

M M 

So, ^ L flu < ]vTT ~ ^"'^ ^ ' 1^1 ^ S ^ ~ ^- Thus, jUz,(B) = 0, C{y) = r(y) ^L-a.e. and C approximates T. 

n=A'+l n=l 

IV. Suppose now that i is «-periodic. We prove first that a h.a. T of T also can be chosen to be «-periodic. The 
relations (l32l i imply that for almost every point y e F if y has a standard period with respect to T, then this period 
is a multiple of n. Indeed, if y satisfies ( |32] |. and its standard period is nq + r for < r < «, then °y = °T"''^''{y) = 
^«</+r^ _ -j-r^' Qy-j^ which is impossible since T is n-periodic. By Saturation Principle, there exist an internal set / C F 
such that Hi (/) = 1 and a number e *Noo such that for every point y E I, whose period is less, than A^, this period is 
a multiple of n. 

Consider the representation ( |28] l of T and set n, = nqi + r, , r,- < n for each / < b. Let F' C F be the set obtained 
by deleting from F the last r,- elements of the i-th cycle for each / < b. The set F' has the Loeb measure equal to 
1 . Indeed, all the deleted elements either belong to the set F \ /, whose measure is 0, or to a cycle whose length is 
greater, than A^. The number of these cycles does not exceed ^ and the number of deleted points in each such cycle 
is less, than n. So the Loeb measure of the set of these points is also equal to 0. Since /iL(F') — 1 the pair (F',st) is a 
h.a. of [0, 1]. The construction of F' defines also the permutation T' : F' — > F' such that 

)■ (33) 

Notice, that actually the number of cycles in T' may be less, than b, since in case of qt = the /-th cycle is empty. How- 
ever, the dynamical system (Y\jj.L, T') is a h.a. of the dynamical system {X,v,t). Indeed, let D = {y E \ T (y) 
T'{y)}. ThenDC {jeF' | T{y) G F\F'} C T-\Y\Y'). Thus, < ;Ul(F \ F') = To obtain an n-periodic h.a. 

of T it is enough to split each cycle in the representation (|33] ) in cycles of length n. Indeed, let the obtained cycle be 

T" = {zi,---,Zn){Zn+l,---,Z2-n) ■ ■ ■ i •••i-Z;-n) • • • {Z(K-l)-n+li ■■■^ZK-n), 

where K = \Y'\/n. It is easy to see that T"{y) ^ T'{y), only for the points z/.„. Notice, that ^liizi-n \ i < K}) = ^ > 
However, due to ( l32b and the n-periodicity of T, for almost all of these points one has 

T'{zi.n) =Zi„+l ~ t(°Z,-.„+i) = t"(°Z(,-_i).„+i) = °Z(;_i).„+i . 

At the same time T"{zi.„) — Z(,-i).„+i by the definition. Thus, T"{y) « T'{y) for almost all y. 

V. To complete the proof of the theorem for X = [0, 1] we need to consider the case when all orbits of T have the 
same standard period n. In this case M — N -n. 

It is easy to see that there exists a selector / C F (subset that intersect each orbit of T by a single point) that is dense 
in *[0, 1], i.e. the monad M(I) = *[0, 1]. It is enough to show the existence of a selector that intersects every interval 
with rational endpoints. Obviously, for every finite set A of such intervals, there exists a selector that intersects each 
interval from A. The existence of a dense selector follows from the Saturation Principle. 

Let / = {yi < y2 < ■ ■ ■ < yw} be a dense selector. Here < is the order in *[0, 1]. Due to the density of / in *[0, 1] for 
every k <N one has yi^ « yk+i- Obviously, the transformation T can be represented by a product of pairwise disjoint 
cycles as follows: 

T = (yi, r«- Vi)(3'2, V2) . . . (yN, -X'-'yN) 

Consider the following cycle S of the length M: 

S^{yu-,T"-'yiy2,.:J"-'y2...yN,-J"-'yN) 

Since for every k <N holds T"{yit) — yi^, one has 

°S{T"-'{y,)) - Wi = °yk = °T"{yt) = °T{T"-\y,)) = xCT^-'iy,)) 

for almost all k. Thus, °S{y) — T{°y) for almost all y and the cycle 5 is a h.a. of T. 

We proved actually that for every h.a. F of ([0, l]),dx) there exists an internal set F' C F with /Xl(F') = 1 and 
a permutation T' :Y' ^ Y' such that the hyperfinite dynamical system (F',/ii,r') is a h.a. of the dynamical system 



23 



{X,v, t) and T' is a transitive permutation of Y' (see Part IV of this proof). To obtain a transitive h.a. T :Y of T, 
set T' — {zi , and F \ 7' = {ui, ...,u^y\y'\} ™d consider the cycle of the length \Y\ 

T : (zi,...,Z|j'/|,Ml,...,M|y\y/|) 

Since jXiHy <E Y \ T'{y) ^ T{y)}) = the transformation T is h.a. of T. 

VI. The statement of the theorem for the case of an arbitrary dynamical system (X, v, t), satisfying the conditions, 
follows immediately from Lemma |2] Indeed, let a set Z? C X, a set C C [0, 1], a bijective map \jf : B ^ C and a 
bijective lifting G : F *[0, 1] of satisfy the conditions of Lemma|2] Then IS a measure 

preserving transformation. Fix an arbitrary h.a. Y of the measure space {X, v). Then by Lemma|2]the hyperfinite set 
Z G(y) is a h.a. of ([0, l],dx). By the results proved in the parts I-V, there exists a permutation S . Z ^ Z that is a 
h.a. of A. Then it is easy to see that the permutation T = G^^SG : F ^ F is a h.a. of T. Obviously, if 5 is a transitive 
permutation, then T is a transitive permutation as well. □ 

iii) (Proof of Theorem^) Let {X,p) be a compact metric space. Consider a hyperfinite set Y C *X. This set 
defines a Borel measure Vy on X by the formula Vy{K) = jii{st^^{K) CiY). Obviously F is a h.a. of the measure 
space {X,Vy)- Let T : F — > F be an internal permutation that is 5-continuous on A for some (not necessary internal) 
set A C F with UtiA) = 1, i.e. 

Vfli ,a2 € A (fli « fl2 =^ r(fli) sa r(fl2))- (34) 

Notice that since st^^(5f (A)) D A and IJ.l{A) = 1, the set st(A) C X is a measurable set w.r.t. the completion of the 
measure Vy, which we denote by Vy also, and Vy{st{A)) = 1. 

Define a map Tt ■ X ^ X such that T7'(st(3')) = st{T{y)) for y E A and Tj f X \ st(A) is an arbitrary measurable 
permutation of the set X \ st(A). 

Proposition 21 The map Tj preserves the measure Vy. 

Proof. Replacing, if necessary, A by f] T" (A) we may assume that A is invariant forpermutation T. Then, obviously, 

nGN 

St (A) is invariant for Tj-. 

Consider a closed set B CX. We have to prove that Vy{Tj^ (B)) ~ Vy{B). One has 

Vy{Zj'{B)) ^Vy{Tj\B)nst{A)). 

It is easy to check that 

Tt\b) n st(A) = sl{T-\st-\B)) n A). 

Thus, 

vy(T^'(fi))=ML(st-'(st(r-'(st-'(B))nA))) -AiL((sr'(st(r-'(st-i(B))nA)))nA) 

Using ([34]) and the T-invariance of it is easy to check, that 

st-^(st(r-^(st-'(B))nA))nA = r-^(st-'(B))nA). 

So, 

VyiT^'iB)) ^ ^iL{T-\si-\B))nA)) ^ ^L{T-\si-\B)) = UList-HB)) = Vy{B). 

In the last chain of equalities we used the facts that I-Ll{A) = 1 and that T being a permutation preserves the Loeb 
measure. □ 

Proposition 22 1) In conditions of Proposition \2l\ for any a > and for any y G F the following positive functional 
la{-J,y) on C{X) is defined: UfJ^y) = °AK{*fJ,y), where °(|) = a and f E C(X) 

2) If^K^L G *N<x, ~ ^ ~ => Aa-(*/, T,y) fiiAL{*f, T,y)), then lo{f, T,y) is defined by the same formula as 
in 1). In this case lo{f,T,y) = f{y) 

3) IfT :Y ^Y is S-continuous, then the functional lo{-,T,y) is Xj-invariant for all y £Y. 



24 



Proof. The correctness of the definition in 1) follows from Theorem|6] The statement 2) follows from Proposition 
I20I To prove statement 3) notice that if T is 5-continuous on Y, then Zj is continuous on X and, thus, *(/o Tj) f F is 
a hfting of foZj. So, 

yyVKe *N *(/oTr)(r^W) «/(Tr(T^(3'))) ^/("r^+Hy)) « yir^+'y) 

These equivalences allows to prove that Aa:(*(/ o t), 7,37) « Aa'(*/, T,y). □ 
Now we can complete the proof of Theorem|9] 

Let y GY satisfy conditions of the theorem. For a number K E *N we denote the initial /T-segment of the T-orbit 
of Y by S{K,y). Then for any K e *Noo one has st{S{K,y)) = Y, since the closed set st{S{K,y)) contains the T-orbit 
of st{y). Let Khe a T-period of y. Then K G *Noo. Otherwise, the T-orbit of st(3') would be finite, while we assume 
X to be infinite. It is easy to see that it is enough to prove the theorem for every G *Noo such that N < K. Under 
this assumption all elements of the set Yi = {y,Ty, ...,T^^^y} are distinct. Since st(yi) ^X, the set Yi defines the 
Borel measure Vf, on X. Let 7i : — ?> Yi be the permutation of Yi that differs from T only for one element T^^^y: 
Ti (r^^'y) = y. Set A = Yi\ {r^^'y}. Then X, t, Yi, Ti, and A satisfy conditions of Proposition E] jUz,(A) = 1, 
Vz e A st(riz) = T(st(z)), i.e. Tr, = T and 7\ is 5-continuous on A, since T is a continuous map. By Proposition|2T| 
the measure Vy^ is T-invariant. Thus, Vy, = V due to the unique ergodicity of the map T. If / G C{X), then obviously 
*/ \ Yi is an 5-integrable lifting of /. This proves the equality (fTSI l. □ 
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